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1  Overview 

“Monitoring  of  target  movements,  Emplacement  of  a  device,  and  Control  of  the  device  in  a 
Halo,”  or  MECH,  is  an  analytical  abstraction  to  model  the  locational  relationships  between  a 
target  and  its  attackers  (around  the  route)  in  asymmetric  conflicts1.  A  conceptual  diagram  of  the 
MECH  model  is  illustrated  on  the  cover  of  this  document.  The  MECH  V0.1  software  system 
ranks  and  predicts  the  relative  likelihood  of  locations  that  may  be  used  for  asymmetric  conflicts 
based  on  probabilistic  reasoning  of  attackers’  behaviors,  utility  of  inter-visibility  for  actions  and 
protection,  and  machine  learning  (ML)  based  pattern  classification.  The  behavior  modeling 
subsystem  computes  and  compares  cumulative  utility  of  locations  within  an  area  of  interest 
(ROI)  based  on  the  combination  of  behavior  constraints  defined  in  a  Halo  shape,  visibility 
models,  and  risk  aversion  criteria.  The  user  can  also  customize  an  ensemble  of  ML  classifiers, 
preprocessing  of  features  of  historical  data,  as  well  as  training  algorithms.  The  two  subsystems 
make  independent  predictions  for  cross  assessments  of  the  tactical  situations. 

The  system  architecture  of  MECH  vO.l  is  shown  in  Figure  1.  The  Android  MECH-App  shown  on 
the  left  side  of  the  figure  is  for  end  users  to  request  tactical  risk  assessments  for  a  ROI,  which  can 
be  a  point ,  a  route  between  two  points,  or  a  rectangle  defined  by  2  diagonal  points.  The  MECH 
web  portal  server  (MECH-WPS)  shown  on  the  right  side  of  the  figure  is  responsible  for 
performing  studies  created  by  the  users.  The  MECH  classifier  training  subsystem  (MECH-CTS) 
supports  import  of  raw  data  and  feature  generation,  configuration  of  classifier  training 
experiments  and  performance  reports,  and  creation  of  ensembles.  As  needed,  MECH-CTS  can 
run  on  a  different  computer  to  share  the  computing  workload  of  the  MECH-WPS. 
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Figure  1.  Organization  of  Primary  Functional  Components  for  MECH  vl.O 


1  MECH  offers  important  insights  on  utility  of  locations  for  certain  types  of  asymmetric  conflicts, 
but  it  does  not  know  when  or  where  the  next  attack  will  take  place. 
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2  MECH-App 

MECH-App  runs  on  a  touch  screen  based  Android  device  for  end  users  to  access  the 
analytics  tool.  MECH  is  designed  for  users  to  gain  situational  awareness  of  tactical  risks  in  a 
region  of  interest  R,  and  the  Proximity  (P)  of  R.  Each  point  of  R  is  associated  with  a  Halo 
annulus,  whose  parameters  are  defined  with  respect  to  the  tactical  behaviors.  P  is  created  by 
taking  the  union  of  the  Halo  annuluses  of  each  point  in  R.  Any  point  on  R  can  be  an  E  point  (for 
device  emplacement),  and  any  point  p  in  P  can  be  an  M/C  (monitor  of  the  target  and  control  of 
the  device)  location.  MECH-App  accesses  the  Google  Map  service  for  map  operations,  and  the 
MECH- WPS  for  the  tactical  analytics,  respectively.  MECH  v  0.1  supports  five  major  studies: 

(CA1)  Basic  Measurements:  Several  measurements  derived  from  Line  of  Sight  (LOS)  on 
P  and  R  locations  within  a  study  area. 

(CA2)  Behavioral  Modeling:  Probabilistic  reasoning  of  locations  for  M,  E,  and  C 
activities.  Tactical  parameters  can  be  defined  based  on  a  risk  averse/seeking  Halo  model. 

(CA3)  Machine  Learning  (ML)  Classifier:  Classification  of  R  points  by  using  one  of  the 
trained  ML  classifiers  stored  on  the  MECH- WPS. 

(CA4)  Past  Events:  Past  events  in  the  displayed  map  area  of  the  APP. 

The  CA1-CA4  tabs  are  organized  as  a  group  in  the  Android  navigation  drawer  (Figure  2.1  (a)), 
which  is  initially  hidden  when  MECH-App  is  first  launched.  It  can  be  brought  to  the  screen  by 
swiping  the  left  up  edge  of  the  main  display.  CA4  is  permanently  displayed  on  the  action  bar 
(Figure  2.1  (b))  on  the  top  of  the  screen  so  that  historical  incident  sites  can  be  superimposed  on 
the  currently  displayed  map. 


Figure  2.1.  The  main  menu  for  MECH  vO.  1 .  (a)  The  navigation  drawer,  and  (b)  the  action  bar. 
Main  modules  in  the  MECH-App  are  summarized  as  follows: 


Modules 


Description 


Affected 

Studies 
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MO 

(1)  Reset  the  map.  (2)  Homing  and  acquiring  of  the  base  map  from  the  Google 
map  server. 

CA1-CA3,  CA4 

Ml 

Set  the  study  area,  either  as  a  point  or  a  route  between  two  points. 

CA1-CA3 

M2 

Set  up  the  Halo  model  parameters  (i.e.,  sight  distance,  fire  Range,  and  blast 

Range,  and  the  distance  curve  modes,  etc.)  for  M3.  This  module  does  not  consider 
the  risk  averse/seeking  tactics. 

CA1 

M3 

Select  a  Line-of-Sight  (LOS)  based  measurement  and  the  Halo  model.  User 
defined  Halo  parameters  are  used  if  M2  is  run  prior  to  M3.  Otherwise,  default 

Halo  parameters  will  be  used  for  the  study  if  M2  was  not  run. 

CA1 

M4 

Set  up  the  risk  averse/seeking  Halo  parameters  in  attackers’  tactical  parameters. 

CA2 

M5 

Select  one  of  the  assessment  functions  to  be  sent  to  the  MECH-WPS  for  study, 
and  pass  the  study  results  to  M8  for  display. 

CA2 

M6 

Overlay  display  of  the  historical  sites. 

CA4 

M7 

Adjust  the  display  range  of  a  heat-map  display,  and  the  cut-off  threshold  of  points 
to  be  displayed. 

CAl,  CA2 

M8 

Draw  the  heat  map  for  a  study  result. 

CA1,  CA2,  CA3 

M9 

Select  a  trained  classifier  from  the  MECH-WPS  for  study  of  a  route. 

Step  1  of  CA3. 

M10 

Contact  the  MECH-WPS  for  classification  of  the  chosen  route  points.  The 
prediction  results  are  sent  to  M8  for  display. 

Step  2  of  CA3 

Action  Bar 

The  appearance  of  the  action  bar  on  the  top  does  not  change  in  most  scenarios. 


Control  Button 

Actions 

STUDY  AREA:  ROUTE  ^ 

It  selects  a  route  "/Tfor  study.  A  route  is  selected  by  tap-and-hold  one  point  on 
the  map,  and  then  tap-and-hold  another  point.  The  APP  will  highlight  the  route 
that  has  been  selected. 

^  LOCATE  AF 

It  brings  the  map  to  the  Afghanistan  region.  (As  of  writing  this  document,  the 
APP  only  works  for  the  Afghanistan  region.) 

0  Cl  FAR  MAP 

It  erases  all  overlay  points  on  map  and  resets  all  parameters  to  their  default 
values. 

PAST  EVEMTS 

Historical  incident  sites  in  the  display  area  can  be  displayed  anytime  by 
tapping 

Navigation  Drawer 

The  navigation  drawer  will  expand  to  show  operations  available  in  (CA1-CA4)  by  tapping  its 
button. 

CA1:  Basic  Measurement 

CA1  produces  LOS  based  measurements  without  considering  behavior  aspects.  The  main  menu 
is  shown  in  Figure  2.2.  The  route  curvature  and  route  exposure  produce  R  points  as  outputs,  and 
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all  other  analyses  produce  P  points  as  outputs.  While  all  P  and  R  points  are  analyzed,  only  points 
that  have  the  highest  values  are  returned  to  the  App.  (The  same  rule  applies  to  all  studies.) 


Brae  Measurement 

Setting* 


Concealment 

Observability  »  Concealment 
Observability  *  Concealment 


Number  ol  Cover 
Mm  Distance  to  Cover 
Uniformity  of  Cover 
Quadrant  Placement  of  0 


•■■•■A* obi 


Number  of  Cover 


Mm  Distance  to  Cover 


Uniformity  of  Cover 


Quadrant  Placement  of  Cover 


|Road  Exposure  Fire  Range  lflDa- 
Blast  Range  350 — 


Figure  2.2.  Main  Menu 


Figure  2.3.  Parameters  setting 


Workflow: 


M8 


The  user  selects  a  route  (Ml),  sets  parameters  (M2,  in  Figure  2.3),  and  then  chooses  the  type  of 
study  (M3,  in  Figure  2.2).  The  Halo  model  can  be  accessed  by  tapping  the  “Halo  Parameter 
Setting”  button,  and  the  user  can  adjust  tactical  parameters  listed  below  using  the  sliding  bars.  A 
set  of  default  values  will  be  used  for  a  study  if  the  user  skips  this  step.  After  the  result  is 
returned,  the  user  can  manually  adjust  the  display  range  (M7,  in  Figure  2.4),  as  well  as  the  points 
of  interest  (POI)  (M7)  after  the  results  are  displayed.  The  study  can  end  here,  or  the  displayed 
results  on  P  points  can  be  used  for  behavioral  modeling  in  CA2. 


Figure  2.4.  Result  after  adjusting  display  radius  and  POI  threshold,  (a)  Before  the  POI  is 
adjusted,  and  (b)  after  the  POI  is  adjusted. 


Halo  Parameter  Setting 
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The  following  notations  represent  the  utility  of  the  physical  measurement  based  on  user  defined 
utility  curves. 


2.1 


2.2 

2.3 

2.4 

2.5 

2.6 

2.7 

2.8 

2.9 

2.10 

2.11 

2.12 


Observability  Uv( 


Observability 


|):  The  cumulative  LOS  values  between  a p  point  to  all 
R  points.  The  score  of  a  point  p  is  proportional  to  the  number  of  R  points  that  it  can 
see.  The  computation  is  done  for  all  p  points  within  the  Halo  radius,  along  each 
point  on  R,  but  only  points  with  the  highest  scores  are  returned  to  the  MECH-App 
for  display. 

Concealment  Uc  The  number  of  points  around  p  with  no  visibility  to 

R.  This  tab  produces  p  points  with  highest  Uc  scores. 

Concealed  observability Ucv:  A  combined  measure  of  Uv and  Uc.  Ucv  can  be 


“additive”:  Uc  +  Uv  (| 

(I 

Aiming  timing  UT(  j 


Observability  +  Concealment 


Observability  *  Concealment 


Aiming 


,  or  “multiplicative”:  Uc  x  Uv 
),  as  specified  by  the  user. 

):  The  ability  for  a p  point  to  see  a  target’s  continuous 


movements  for  150  meters  before  reaching  a  particular  location  on  R. 

Hiding  UH(  BT" 


| ):  The  sum  of  Unc,Umc,  Uuc,  Upc  and  U fCfor  a  p  point.  The 
radius  of  the  usable  hiding  area,  or  escape  path  from  the  p  point  is  fixed  at  350 
meters. 

):  The  number  of  covers  around  a  p 


Number  of  Covers  (t/nc)(| _ 

point. 

Shortest  Distance  to  a  Cover  (Umc)( 


Number  of  Cover 


Min  Distance  to  Cover 


):  The  shortest  distance 


Uniformity  of  Cover 


):  The  standard  deviation  of 


for  a  p  point  to  reach  a  cover.  The  score  Umc  is  inversely  proportional  to  the 
distance. 

Uniformity  of  Covers  (Uuc)( 

distances  between  a p  point  and  its  covers. 

Quadrant  Placement  of  Cover  ( Upc )  ( 

(the  4)  quadrants  around  p  that  have  covers. 


Quadrant  Placement  of  Cover  i 


The  number  of 


Front  Cover  ( U fC )  ( 
along  the  side  facing  R. 

Route  Exposure  ( 


Front  Cover 


):  The  number  of  invisible  points  around  a  p  point, 


Route  Exposure 


I ):  For  each  point  r  on  R,  the  number  of  p  points 
within  the  study  area  defined  on  R  that  can  see  r.  That  is,  which  points  on  R  have 
the  highest  visibility  from  P. 


Route  Curvature 


Route  Curvature  ( 

straightness  of  the  road  segments. 


):  The  curvature  of  road  segments  on  R.  Or, 


CA2:  Behavioral  Modeling  ( 


Strategic(R  level)  Assessment 


) 


Three  types  of  studies  are  supported  based  on  the  risk  averse/seeking  behavioral  model 
defined  in  the  Halo  model. 
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Types  1  &  2:  E  locations  for  IED&  DF  Attacks 

The  IED  and  DF  studies  follow  identical  operational  steps,  but  use  different  control  buttons 
to  access  different  tactical  models  on  the  MECH-WPS.  They  both  use  a  set  of  P  locations 
produced  in  CA1  as  the  potential  M/C  locations,  and  then  the  study  produces  the  E  locations 
with  the  highest  risk  scores. 

Step  1:  Tap  the  “Halo  Parameter  (IED/DF  based)”  button  to  open  a  new  menu  for  adjustment 
of  tactical  parameters  in  the  Halo  model.  Default  values  will  be  used  if  this  step  is  not  taken. 


Step  2:  Tap  the  “Start  IED/DF  Risk  Assessment”  button  to  request  the  MECH-WPS  to  run 
the  study. 

The  “A”  symbol  in  the  workflow  chart  below  means  that  both  M4  (setting  of  Halo 
parameters)  and  the  chain  of  Ml -M2 -M3  need  to  be  run,  but  the  two  branches  need  not 
be  in  a  specific  order.  In  comparison  to  the  Halo  model  used  in  CA1,  M4  is  a  more 
elaborate  version  that  supports  characterization  of  risk  averse/seeking  behaviors. 


IED&DF  Workflow: 


Type  3:  R2P  Study 

This  study  uses  all  R  points  to  study  their  proximity  points  within  the  radius  of  the  Halo  model. 
The  study  produces  a  list  of  points  that  have  the  highest  M/C  scores. 

Step  1:  Tap  the  “Halo  Parameter  Setting  (R2P)”  to  set  up  the  Halo  parameters. 

Step  2:  Tap  the  “Start  R2P  Assessment”  to  produce  the  heat  maps  of  P  points  with  the  highest 
scores  with  respect  to  R. 


R2P  Workflow: 


Halo  MECH  Parameter  Setting  (Figure  2.5) 


A  screen  shot  of  the  Halo  model  setup  page  is  shown  in  Figure  2.5  (Note,  the  full  length  menu  is 
cut  and  then  fit  into  the  horizontal  space  of  the  document.)  The  display  is  organized  into  5 
views.  In  view  2,  the  center  of  the  Halo  is  the  victim  location,  and  the  M/C  location  can  be 
anywhere  within  the  sight  distance  (blue  circle)  but  outside  of  the  blast  range  (red  circle).  View 
1  is  dedicated  to  setting  the  geometric  parameters  of  the  Halo  model,  which  are  listed  in  the 
following  table.  They  are  adjusted  by  swiping  the  sliding  bars. 


Parameters 


Description 
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Sight  Range 
(blue  circle) 

The  outer  radius  of  the  Halo  based  on  the  human  sight  range. 

Blast  Range 

The  blast  range  of  an  improvised  explosive  device  (IED)  (The  inner  radius  of  Halo  annulus). 

(red  circle) 

Attackers  do  not  stay  in  this  range. 

Aiming  Range 

A  range  for  MIC  points  to  see  the  target  continuously  move  along  the  route  to  the  attack 

(light  blue  line) 

engagement  location  E. 

Device  Triggering  Range 

IED  attacks:  the  maximum  range  to  trigger  an  IED  device. 

(yellow  line) 

DF  attacks:  the  shooting  range  of  the  attackers. 

Return  Fire  Range 
(black  line) 

The  range  of  return  fire  by  the  victims  from  E  to  the  MIC  location. 

Retreat  Distance  to  a  cover 

The  reachable  distance  to  a  cover.  The  choice  can  be  the  nearest  or  a  randomly  chosen  one  based 

(green  circle) 

on  the  behavior  model. 

Halo  Parameters  for  MECH  Models 
(units:  meters) 

Max  Sight  Distance: 

3000 

f 

Max  Blast  Distance: 

350 

■ 

Aiming  Precision  Range: 

150 

Defensive  vs.  Offsensive 
(units:  percentages) _ 

Defensive  40  60  Offensiv< 

■ 

Cut-off  Threshold  m 
Cut-off  Threshold:  ao 


Device  Triggering  Distance:  3000 


MECH  Utiliy  Curves 

Distance  Weighted  LOS 
Sconng 

Observability  Ut.Wy  (Uv» 

Operation 

Aiming  Precision 
Scoring  (U,) 

Operation 

Concealment  Scoring 
&0 

Operation 


Figure  2.5:  Halo  Parameters  for  MECH  Models 


Risk  Averse  Behaviors  in  Tactical  Planning  (Views  3,4  of  Figure  2.5) 

Attackers  go  through  formal  or  informal  optimization  (i.e.,  prioritization,  trade  off  choices)  of 
their  offense  (risk  seeking)  and  defense  (risk  averse)  measures  in  planning  tactical  operations. 
MECH  offers  a  generalized  expression  to  incorporate  a  few  offense  and  defense  measures.  Let 
the  symbol  “A”  represent  a  multiplication  “x  "  or  addition  “+"  operation  between  two  variables. 
A  generalized  utility  function  that  represents  a  combination  of  the  offensive  and  defensive 
measures  can  be  expressed  as  follows: 

/ Wo,  U d)  =  s0  ■  sd[cu0(1/0)A  (odWd)]- 


s0  and  sD  represent  two  threshold  switches  of  the  offense  and  defense  utilities.  They  overwrite 
the  value  of /(l/0, 1/D)  to  zero  if  either  of  the  utility  values  (U0),  and  (UD)  is  smaller  than 

).  The  two  coefficients 


the  thresholds  set  by  the  user  using  the  sliding  bars  ( 

<n0and  (oD  define  the  relative  weights  of  the  offense  vs.  defense  utilities.  The  ratio  between  them 
is  adjusted  by  the  sliding  bar  at  top  of  view  3.  By  proper  adjustment  of  these  parameters,  the  user 
can  study  a  wide  range  of  risk  averse-seeking  behaviors. 
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Every  utility  in  view  4  is  derived  using  LOS  as  the  building  block.  The  standard  definition  of  the 
LOS  between  two  points  does  not  consider  their  distance,  but  this  may  not  be  the  case  in  the  real 
world  environment.  In  MECH,  the  user  can  use  the  distance  to  weight  the  tactical  value  of  LOS 
using  one  of  the  built-in  distance  curve  functions  (No  curve,  step  function,  linear  decrease,  and 
rapid  decrease).  They  are  organized  into  a  pull  down  menu  for  the  user  to  pick  the  preferred 
mode  from  the  four  different  distance  curve  functions: 

(1)  No  curve:  The  distance  is  irrelevant  in  the  tactical  study. 

(2)  Step  function:  The  tactical  value  of  LOS  becomes  zero  when  the  distance  is  greater  than 
2000  meters. 

(3)  Linear  decrease:  The  tactical  value  of  the  LOS  decreases  at  the  rate  of  1 /distance. 

(4)  Rapid:  The  tactical  value  of  the  LOS  decreases  rapidly  at  the  rate  of  Vexp(d)  ’  w^ere 
exp  is  the  exponential  function  and  d  the  distance. 

The  remaining  buttons  in  view  4  are  meant  to  describe  details  of  the  utilities  U0  and  UD  of  the 
offensive  and  defensive  measures: 

U0=  (UyAUr), 

where  Uv  and  UT  represent  observability  and  aiming  for  the  offensive  measure,  respectively. 

UD  =  a>D  [Uc  4  (y„c 4  Uync^  £4cA  UpcA  Ufc)l 

where  Uv,  UT,  Uc,  Unc,  Umc,Uuc,  Upc,  and  UfC  are  defined  in  CAL  By  adjusting  a  few  sliding 
bars,  the  user  can  easily  select  which  of  these  factors,  together  with  their  weights  to  be  used  for  a 
study. 


CA3:  Machine  Learning  Classifier  ( 


Machine  Learning  Classifier  Output 


l 


MECH  supports  a  2-label  (“incident”  (Y)  vs.  “non-incident”  (N)  )  classification  of  R 
locations.  A  common  interpretation  of  the  “Y”  (“N”)  output  for  a  location  X  is  that  the  features 
associated  with  X  are  more  similar  to  that  of  the  incidents  (non-incidents)  used  in  the  training 
process.  The  user  can  run  a  study  by  simply  following  the  three  steps  of  (1)  selecting  a  route,  (2) 
selecting  a  classifier,  and  then  (3)  sending  the  request.  The  prediction  will  be  made  to  all  points 
on  R  using  the  chosen  classifier,  and  the  result  is  displayed  on  R  in  the  heat-map  format. 
Workflow: 


>  M8 
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3  MECH-CTS 


MECH-CTS  is  responsible  for  importing  raw  data  and  their  transformation  into  useable  forms 
for  all  algorithms  in  MECH.  It  is  also  responsible  for  training  and  performance  evaluation  of 
classifiers.  As  of  writing  this  report,  the  whole  application  runs  as  one  Matlab  program  by  a 
command  line  statement: 


“Matlab  -r  CTS.m” 


Main  User  Interface 

The  main  user  interface  of  MECH-CTS  is  shown  in  Figure  3.1.  The  navigation  bar  on  the  top 
(view  1)  allows  the  user  to  run  one  of  the  three  functions,  Feature  Generation  (  Feature  Generation^ 
Classifier  Training  (  Classifier  Training^  and  Classifiers  Ensemble  (  Classifier  Ensemble  ).  Details  of  a 


selected  function  are  displayed  below  the  navigation  bar.  For  instance,  the  snapshot  illustrated  in 
Figure  3.1  is  the  display  after  (  Feature  Generation!)  is  clicked. 


Figure  3.1.  The  main  user  interface  for  MECH-CTS 


Feature  Generation  (  Feature  Generation |) 

This  module  is  responsible  for  (1)  importing  raw  data  (historical  data  file,  road  points  file,  DEM, 
population  file),  (2)  generation  of  features  and  uploading  them  to  the  database.  The  display  space 
for  this  module  is  organized  into  FG1-FG4. 

FG1.  The  user  uses  the  ( Raw  Data  Import )  button  to  select  files  that  contain  incident  sites, 
population  and  DEM  data. 

FG2.  After  clicking  the  (  Generate  Features  | )  button,  the  feature  generating  process  will 
start  to  run,  while  the  features  being  generated  are  streamed  on  view  FG1 . 

FG3.  The  user  can  specify  the  database  to  store  the  features. 
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FG4.  Operation  log  and  the  progress  bar  of  the  process. 


After  they  are  loaded  into  the  database,  the  input  data  and  their  transformed  features  can  be  used 
by  all  applications,  including  the  MECH-CTS. 

Classifier  Training  (  Classifier  Training | 

This  module  is  responsible  for  feature  preprocessing  (feature  normalization  and  feature 
reduction),  running  the  training  algorithms  of  classifiers,  evaluation  of  their  performance  on 
different  data  sets,  and  upload  of  the  trained  classifiers  to  the  MECH-WPS.  Once  uploaded  to 
MECH-WPS,  trained  classifiers  can  be  further  grouped  by  the  MECH-CTS  to  create  ensembles. 
The  end  user  of  MECH-APP  can  select  an  individual  classifier  or  an  ensemble  to  perform  the 
classification  of  a  study  area.  The  main  GUI  for  the  classifier  training  is  shown  in  Figure  3.2, 
where  the  display  area  is  organized  into  views  TC1-TC5. 


Figure  3.2.  Classifier  training  interface 

TCI,  TC2.1-TC2.3:  Data  Selection  and  Viewing 

TCI .  It  specifies  the  event  type,  focal  point  of  the  study  location  and  its  radius,  and  the  time 
period.  MECH-CTS  then  automatically  generates  the  training  and  testing  data  based  on  the 
specification.  By  clicking  the  (  Show  | )  button,  the  training  data  will  be  shown  in 
TC2.1-TC2.3: 

TC2.1.  It  displays  the  location  of  non-event  points  (blue)  and  event  points  (red)  as  an  overlay  on 
the  Googlemap. 
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TC2.2.  Each  row  represents  one  location,  and  its  associated  features. 

TC2.3.  It  displays  the  viewshed  of  the  point  marked  in  TC2.2. 

When  the  user  specifies  the  time  period  and  area  to  be  used  in  a  training  study,  all  incident 
locations  that  satisfy  the  temporal-spatial  constraint  will  be  retrieved  as  the  incident  data.  Then, 
the  same  number  of  non-incident  data  will  be  randomly  generated.  Combined  together,  2/3  of 
the  combined  data  points  are  used  for  training  of  the  classifiers,  and  the  remaining  1/3  for 
evaluation  of  the  performance  of  the  trained  classifiers.  To  reflect  the  time  sequence  of  events 
faithfully,  the  times  of  all  the  data  points  used  in  the  training  phase  are  ahead  of  those  used  in  the 
testing  phase. 


TC3:  Classifier  Training  Configuration 

The  classifier  training  process  is  configured  based  on  the  combinations  of  the  normalization 
methods,  feature  reduction  methods,  and  the  machine  learning  methods.  Each  particular 
combination  produces  one  classifier  at  end  of  the  training  process.  The  user  can  upload  one  or 
more  classifiers  (each  of  which  represents  one  of  the  combinations)  to  the  MECH-WPS  for 
online  use.  Except  for  the  “Expert”  option,  which  requires  more  actions  by  clicking  the  (  ) 

b  Detail  )l  other  options  can  be  chosen  by  simple  clicking  their  checkboxes.  The  training  process 
starts  by  clicking  the  (  )  button.  Run 


Feature  reduction 

The  user  can  choose  one  or  more  feature  reduction  methods  marked  in  TC3  to  manage  the  77 
features  for  training. 

•  The  (l  lormal  )  mode  uses  the  full  set  of  features  (with  zero  reduction). 

•  The  (  PCA  )  and  ( STP  )  modes  are  based  on  mathematical  transforms. 

•  In  the  (  Expert )  mode,  the  user  manually  chooses  the  features  to  be  used  in  the  training. 


To  enter  the  expert  mode  feature  selection,  the  user  clicks  the  (  DetailJ )  button  next  to  the 
(  Expert )  checkbox  to  see  a  popup  user  interface  for  management  of  groups  of  features.  Figure 
3.3  illustrates  a  snapshot  of  feature  group  21  (marked  in  SFG2)  and  its  list  of  features  (marked  in 
SFG3)  when  the  user  clicks  the  (  Select  Croups  | )  button  (in  SFG1)  in  the  expert  mode.  By  clicking 
the  plaintext  title  of  a  group,  features  of  one  group  can  be  displayed  in  SFG3.  All  feature  groups 
with  marked  “select”  checkboxes  will  be  used  in  classifier  training. 

When  the  user  clicks  the  (  Feature  Group  Clean  up  | )  button  (marked  in  SFG4),  a  new  display 
(Figure  3.5)  will  pop  up  with  the  list  of  feature  groups  already  uploaded  to  the  database.  The  user 
can  remove  any  obsolete  feature  group  as  needed. 
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Feature  Croup  Management 


■  Select  Feature  Croup - 


Description 


1  Chosen  by  Expert  Ti  l 

2  Chosen  by  Expert  CP 

3  Chosen  by  Expert  SC 

4  Sparse  Viewshed  Feature  collect... 

5  Sparse  View  shed  Feature  collect... 

6  Sparse  Views hed  Feature  collect... 

7  Sparse  Viewshed  Feature  collect... 

8  Sparse  Viewshed  Feature  collect... 

9  Low  cost  feature  using  local  mf. 
10  Expansion  based  on  Local 

19  6evatton  Based  Features 

20  People  Factor 


SFG2 


.  j  L 


feaiure  id  | 


Description 


63mmcea 

64  maxcea 

65  mediancea 

66  maxcea  lOOO.routevis 

67  mmcea  lOOO.routevis 

68  mediancea  lOOO.routevis 

69  maxceaSOO.routevis 

70  mmceaSOO.routevts 

71  medianceaSOO.routevis 

72  maxcea 250.routevis 

73  mincea250_routevis 

74  mediancea250.routevis 

75  maxcea  iOO.routevts 

76  mincea  lOO.routevis 

77  mediancea  lOO.routevis 


SFG3 


SFG1 


SFG4 


Feature  Croup  Clean  Up 


Figure  3.3.  Feature  group  selection  in  the  expert  mode. 


The  user  can  create  a  new  group  by  clicking  the  (  Add  Croup  |)  button  in  SFG1  to  switch  to  a 
new  display  shown  in  Figure  3.4,  whose  display  area  is  organized  into  four  areas  NG1-NG4. 
NG1  gives  the  full  list  of  77  features.  The  user  can  view  the  discriminant  ability  of  a  feature  (to 
separate  the  two  Y/N  classes  in  this  feature  space)  in  NG2  by  clicking  the  feature’s  plaintext 
label  displayed  in  NG1.  The  user  can  include  an  arbitrary  number  of  features  into  the  training 
process  by  clicking  their  checkboxes.  NG3  is  used  to  enter  brief  remarks  (rationale,  why  certain 
features  are  being  used  or  removed,  etc.)  about  this  feature  group.  By  clicking  the 

( _ Add  The  croup _ j)  button,  the  newly  configure  feature  group  is  added  to  the  database  for 

future  use. 
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Figure  3.4.  Add  a  feature  group  and  its  features. 

After  the  creation  and  selection  process  is  completed,  the  user  should  have  a  list  of  feature 
groups  marked,  and  by  clicking  the  (  confirm  I)  button  in  SFG1,  the  selected  feature  groups  will 
be  passed  to  the  training  modules.  The  display  window  then  returns  to  the  classifier  training 
interface  shown  in  Figure  3.2. 


Figure  3.5.  Delete  feature  groups 

TC4:  Display  of  the  Operation  Log 
TC5:  Display  of  the  Performance  Results 

By  clicking  the  (  Results  )  button,  the  display  will  switch  to  the  performance  result 
reporting  page  in  Figure  3.6.  Each  combination  of  the  training  configuration  and  its  classification 
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performance  is  shown  as  one  row  in  view  Rl.  The  user  can  reserve  one  or  more  of  the  displayed 
configurations  to  be  uploaded  to  the  MECH-WPS  by  clicking  their  “reserve”  checkboxes.  By 
clicking  the  (  upload  | )  button,  the  reserved  classifiers  will  be  uploaded  to  the  MECH-WPS, 
but  the  configuration  still  stays  in  the  MECH-CTS.  The  user  has  the  option  to  run  more 
experiments  by  clicking  (  More  Experiments  )  button,  and  the  display  switches  to  the  training  main 
menu  (Figure  3.2).  A  unique  internal  ID  will  be  assigned  to  each  uploaded  classifier,  together 
with  a  concise  descriptor  of  the  experiment  attributes,  which  will  be  displayed  when  the  end 
user  requests  to  view  available  classifiers  from  their  MECH-App. 


Figure  3.6.  Performance  reporting  and  saving  of  classifiers. 


Classifier  Ensemble  (  ciassmer  Ensemble  |) 

This  module  is  responsible  for  the  creation  of  ensembles  of  trained  classifiers,  which  have  been 
uploaded  to  the  MECH-WPS.  The  user  interface  is  illustrated  in  Figure  3.7  where  the  display  is 
organized  into  three  views  CE1-CE3. 

CE 1 .  Selection  of  Study  Location 

This  view  is  for  the  selection  of  a  particular  location  of  interest  to  create  an  ensemble  from  a 
list  of  available  classifiers,  each  of  which  has  been  trained  around  a  location.  The  list  of 
classifiers  are  displayed  in  the  order  of  their  distances  to  the  location  of  the  current  study.  All 
checked  classifiers  will  be  used  in  the  ensemble. 

CE2.  Selection  of  the  ensemble  architecture 

a.  Voter  based  ensemble:  Classifiers’  outputs  are  fed  to  a  voter,  which  uses  a 
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i.  (  Majority  rule  ):  the  ensemble  output  is  the  majority  of  the  Y/N 
outcomes  of  the  classifiers. 

ii.  (Any  rule  ):  the  ensemble  output  is  “Y”  if  any  of  the  classifiers  produces  a 
“Y” 

b.  Stacking  ensemble:  The  ensemble  is  modeled  as  yet  another  classifier,  whose 
inputs  are  the  outputs  of  selected  classifiers.  The  ensemble  in  this  option  goes 
through  the  training  process  similar  to  earlier  ones  to  optimize  its  parameters. 

CE3.  Performance  Validation 

By  clicking  the  (  Pljn  E^i  |  )  button,  the  performance  of  the  selected  ensemble 
architectures  is  tested  using  a  newly  generated  data  set  around  the  study  area  to  assess  the 
performance  of  the  ensemble.  By  clicking  the  (  Save  Selected  |  )  button,  marked  ensembles  are 
uploaded  into  the  MECH-WPS  for  on-line  prediction. 


File 

- 

Feature  Generation  | 

Classifier  Training| 

Classifier  Ensemble 

Welcome  Mr.  Enenhooer.  Today  1*  June; 27/2014 

Figure  3.7.  Classifiers  ensemble  interface 


4  MECH-WPS 

MECH-WPS  provides  a  web  portal  for  end  users  to  access  the  services  provided  by  the 
computing  engines.  Installation  of  the  MECH-WPS  package  is  the  only  operation  most  relevant 
to  the  user. 
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Appendix  1.  Features  Used  in  the  MECH  Classifiers 


Emplacement  Related  Features 

Type 

Descriptors  and  Descriptions  (unit:  1  pixel  =  33.4  meters) 

Elevation 

Elevation 

The  height  above  or  below  sea  level. 

Slope 

Slope 

The  absolute  value  of  the  change  rate  in  elevation  along  steepest  path. 

Shape 

IWconvexity 

The  surface  curvature  of  a  circle  area  (radius  =10  pixels).  (Smaller  values 
imply  smoother  areas.) 

Shape 

IW  texture 

The  number  of  pits  divided  by  the  number  of  pits  and  peaks  in  a  circle  area 
(radius  =10  pixels,  or  334  m ). 

Visibility 

RtVisMin  lOO,  RtVisMedlOO,  RtVisMaxlOO 

Minimal  (Min),  Medium  (Med),  and  Maximum  (Max)  of  visibility  at  the 
distance  of  100  meters  to  the  route. 

Elevation 

Elv_mg50 

The  difference  between  largest  and  smallest  elevations  with  50  meters. 

Shape 

Rough_50 

The  standard  deviation  of  elevations  with  50  meters  at  a  location. 

Shape 

Local_op_4,  Local_op_8,  Local_op_16,  Local_op_32,  Local_op_64 

Sparse  view  shed ,  the  view  shed  along  n  (n= 4,  8,  16,  32,  64)  equally  spaced 
directions. 

Viewshed:  an  indicator  on  flatness  of  the  terrain.  Smaller  values  imply 
flatter  terrain. 

Distance 

Dist_pop_l,  Dist_pop_lk,  Dist_pop_10k,  Dist_pop_50k,  Dist_pop_100k 

The  nearest  distance  to  a  city/village  with  the  population  size  of  n,  n  =  1/ 
lk/10k/50k/100k. 

Monitor/Control  Related  Features 

Type 

Descriptors  and  description 

Visibility 

Visidxl00-350,  Visidx 350,  Visidx 500,  VisidxlOOO 

The  number  of  visible  points  within  the  view  shed  of  a  point  (e.g.,  view 

TC2.3  in  Figure  3.2). 

About  the  suffixes: 

100-350:  the  study  area  is  a  halo  annulus  with  inner  and  outer  radiuses  100 
and  350  meters,  respectively. 

350/500/1000:  the  study  area  is  a  full  circle  with  the  radius  of  350/500/1000 
meters. 

Shape 

SCID100-350,  SCID  350,  SCID  500,  SCID1000 
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A  discrete  shape  complexity  index  to  characterize  the  evenness  of  radii 
along  different  directions  in  a  (full)  viewshed. 

About  the  suffixes:  same  as  above. 

Elevation 

ElvmglOO,  Elv_mg350,  Elv_mg500,  ElvmglOOO 

The  difference  between  largest  elevation  and  smallest  elevation  with  n  (n  = 
100,  350,  500,  1000)  meters. 

Shape 

RoughlOO,  Rough_350,  Rough_500,  RoughlOOO 

Same  definition  as  Rough_50,  with  the  range  n  =  100/350/500/1000 
meters. 

Distance 

Short_rad_4,  Short_rad_8,  Short_rad_16,  Short_rad_32, 

Short rad 64 

Short  rad _n,  n  =4, /8/1 6/32/64:  The  shortest  distance  from  the  center  to  an 
invisible  point  along  the  n  directions. 

Distance 

Long_rad_4,  Long_rad_8,  Long_rad_16,  Long_rad_32,  Long_rad_64 

The  longest  distance  from  the  center  to  an  invisible  point  along  the  n  (  n 
=4, /8/1 6/32/64)  directions. 

Distance 

Mean_rad_4,  Mean_rad_8,  Mean_rad_16,  Mean_rad_32, 

Mean rad 64 

Mean_rad_«,  n  =4,/8/ 16/3 2/64:  The  average  distance  from  the  center  to  an 
invisible  point  along  the  n  directions. 

Area 

Planimtrc  4,  Planimtrc  8,  Planimtrc  16,  Planimtrc  32,  Planimtrc  64 

The  area  of  a  sparse  viewshed  based  on  its  pixel  count  along  its  n 
(?z=4/8/16/32/64)  directions. 

surface 

Rugosity 4,  Rugosity 8,  Rugosity 16,  Rugosity 32,  Rugosity 64 

The  surface  area  (which  considers  the  elevations  of  points)  of  a  view  shed 
divided  by  its  planimetric  area  along  its  n  («=4/8/ 16/32/64)  directions. 

Shape 

SCIF  4,  SCIF  8,  SCIF16,  SCIF  32,  SCIF  64 

A  discrete  shape  complexity  index  to  characterize  the  evenness  of  radii 
along  n  (n=  4/8  16/32/64)  directions  in  a  sparse  viewshed. 

Visibility 

Min  CEA,  Med  CEA,  Max  CEA 

Minimal  (Min),  Medium  (Med),  and  Maximum  (Max)  to  the  cumulative 
escape  adjacency  (CEA) 

Visibility 

RtVisMin_250,  RtVisMed_250,  RtVisMax_250 

p  points  around  R  with  the  Minimal  (Min),  Medium  (Med),  and  Maximum 
(Max)  visibility  to  an  R  point,  whose  distance  to  E  is  <  250  meters. 

Visibility 

RtVisMin_500,  RtVisMed_500,  RtVisMax_500 

p  points  around  R  with  the  Minimal  (Min),  Medium  (Med),  and  Maximum 
(Max)  visibility  to  an  R  point,  whose  distance  to  E  is  <  500  meters. 

Visibility 

RtVisMin  lk,  RtVisMed  lk,  RtVisMax  lk 

p  points  around  R  with  the  Minimal  (Min),  Medium  (Med),  and  Maximum 
(Max)  visibility  to  an  R  point,  whose  distance  to  E  is  <  1000  meters. 
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Appendix  2.  Use  Cases 


The  purpose  of  this  note  is  to  illustrate  how  to  use  MECH-App,  MECH-WPS,  and  the  MECH-CTS  to 
perform  different  tactical  studies.  In  the  first  two  examples,  we  illustrate  how  to  use  the  behavioral 
modeling  subsystem  to  answer  tactical  inquiries,  and  the  last  three  for  the  MECH-CTS  related 
applications. 

MECH-App 

1.  Where  may  be  the  best  long-term  monitoring  spots  over  a  route? 

The  two  key  words  "long-term"  and  "monitoring"  imply  that  the  top  locations  should  have 
the  best  observability  over  R,  as  well  as  good  protection  from  being  seen  by  the  victim.  As  a 
result,  either  the  "observability  +  concealment"  analysis,  or  "observability  x  concealment" 
could  best  answer  the  query. 

2.  Where  may  be  the  three  best  target  locations  on  R  for  planning  a  roadside  IED/DF  attack, 
and  where  might  be  the  best  monitoring  locations  for  such  attacks? 

For  rational  insurgents 

A.  A  successful  attack  would  require  good  observation  of  the  targets,  good  aiming,  and  also 
good  protection.  To  serve  this  purpose,  the  user  can  first  use  the  basic  measurement  to 
produce  a  P  heat  map  of  some  basic  measurements  in  CA1,  and  then  invoke  CA2  to 
produce  the  results. 

B.  Starting  from  the  exposure  or  curvature  analysis  in  CA  to  identify  the  highest  valued 
positions  on  R.  Then,  use  these  points  to  identify  best  P  points  by  using  the  R2P  study. 

3.  Where  may  be  a  good  E  location  to  attack  a  convoy? 

Different  studies  can  be  done  in  a  hierarchical  fashion.  It  starts  with  basic  measurements  of  the  R. 
Then,  high  level  studies  can  be  built  up  the  heat  map  on  R,  based  on  the  assumptions  on  the  level  of 
sophistications,  team  sizes,  etc. 

MECH-CTS 

Case  1 

It  is  known  that  the  attack  patterns  of  insurgents  change  with  seasons.  A  team  needs  to  plan  for 
operations  centered  at  a  position  X  (32000oo"N,  67°oooo"E)  for  the  spring  season.  It  is  known  that 
the  insurgent  groups  around  X  have  high  mobility,  with  their  reach  to  120  km. 

Case  Design 

The  team  leader  wants  to  use  the  classifier  to  predict  high  risk  locations  at  proximity  of  X  at  the 
spring  time. 

Analysis  Procedure 

1 .  The  team  leader  decides  to  include  all  possible  attacks  that  may  have  been  planned  by  the 
insurgent  groups  within  their  mobility,  but  confines  the  time  period  of  the  training  data 
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to  1/1/2012-5/1/2012.  He  selects  the  event  type  as  IED  and  then  enters  the  time  period, 
and  the  study  location.  (See  user  guide  Figure  3.2) 

2.  He  then  selects  z-score  and  min-max  for  normalization.  He  further  chooses  stepwise 
(STP)  and  PCA  for  feature  reduction,  and  kNN  and  DA  as  the  two  ML  methods.  By 
clicking  the  Run  button,  MECH-CTS  will  produce  8  classifiers  based  on  the  combination 
of  the  normalization  method,  feature  reduction,  and  ML  training  method  as  follows:  z- 
score-STP-kNN,  z-score-STP-DA,  z-score-PCA-kNN,  z-score-PCA-DA,  min-max-STP- 
kNN,  min-max- STP-D A,  min-max  -PCA-kNN,  min-max-PCA-DA. 

3.  The  team  leader  can  view  the  performance  of  these  classifiers  by  clicking  the  "Result" 
button.  The  lower  the  error  rate,  the  better  the  classifier  is. 

4.  Any  or  all  of  these  classifiers  can  be  uploaded  to  the  MECH-WPS  for  classification  of 
an  unknown  location  nearby  X  during  the  operation  phase. 


Case  2 

As  one  part  of  periodic  system  maintenance  work,  an  analyst  is  tasked  to  review  the  ML 
classifiers  for  the  area  around  x  to  identify  which  of  the  features  have  most  and  least  impact  on 
the  classification  training  process. 

Case  Design 

The  analyst  can  use  the  "New  Group"  panel  under  the  "Feature  Group  Management"  to  visually 
inspect  the  performance  of  each  feature. 

Analysis  Procedure 

1 .  Same  as  step  1  of  Case  1 . 

2.  Open  "Feature  Group  Management"  window  by  clicking  on  the  "Expert"  button. 

3.  Click  on  "New  Group"  button  to  switch  to  "New  Group"  panel. 

4.  The  analyst  wants  to  examine  the  whole  feature  list  to  identify  all  the  features  that  exceed 
an  empirical  threshold  of  discriminative  power.  He  clicks  on  the  feature's  plain  text  label 
to  view  the  discriminant  ability  from  the  box  plot  figure,  e.g.,  Figure  3.4.  The  less  the 
boxes  of  two  classes  overlap,  the  better  this  feature  is  in  discriminating  event  points  vs. 
non-event  points. 

5.  He  clicks  on  the  “select”  checkbox  for  every  feature  that  exceeds  the  threshold. 

6.  He  enters  a  description  of  this  study  in  the  view  NG3  area  (see  Figure  3.4),  and  then 
clicks  the  “Add  group”  button.  By  clicking  the  “Confirm”  button,  the  display  returns  to 
the  classifier  training  interface. 


Case  3 

For  the  same  team  to  operate  at  the  location  X,  the  team  leader  knows  specifically  that  the 
insurgents  would  choose  locations  that  are  easy  to  escape  as  one  of  the  major  criteria  in  planning 
their  actions.  He  had  created  a  feature  group  called  “Escape  Features”  in  earlier  planning. 
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Case  Design 

To  ensure  that  the  escape  route  is  reflected  in  the  classifier  training,  the  team  leader  can 
manually  select  features  by  clicking  the  "Expert"  button  in  addition  to  the  automatic  training 
process  mentioned  in  Case  1 . 

Analysis  Procedure 

The  general  procedure  for  Case  2  is  the  same  as  that  of  Case  1 ,  except  that  the  following  actions 
need  to  be  added  to  step  2. 

1.  The  user  clicks  the  "Expert"  button  to  open  the  feature  group  management  window,  (e.g., 
Figure  3.3) 

2.  The  user  clicks  the  "Select  Groups"  button  to  switch  to  the  Select  Feature  Group  panel 
and  clicks  the  checkbox  for  the  "Escape  Features"  feature  group. 

3.  The  user  clicks  the  "Confirm"  button  to  return  to  the  Classifier  Training  interface  and 
goes  on  with  step  3  of  Case  1 . 
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Appendix  3  MECH-App  software  modules 

Modules 


MO  (Google  map  operations) 


Ml  (Route  selection) 


SR-RV 


L-Route 


is  Google  map 


M2  (BM  settings) 


►  PC  (sight  distance,  curve,  etc} 


M3  (Basic  measurement) 


L-Route - -* 

L-PC  - — ► 


|  Observability 


Route  exposure  Route  curvature 


— SR-RV-*  L-P 

— SR-RV—*  L-R 


Study  zone 
functions 


Locate  country 
Clear  map 
Study  area 
Display  adjustment 


== 

Lists 

Route  points  (L-Route) 
Polygon-point  list  (L-Poly) 
Parameters  Container  (L-PC) 
P  points  (L-P) 

R  points  (L-R) 

Historical  event  point  list  (L-HE) 
Past  events  marker  list  (L-PM) 
Classifier  list  (L-C) 

MECH  functions  | 

Basic  measuremeni 
Historical  sites 
Behavioral  modeling  (BHM) 

ML  classifier  (MIC) 


M4  (BHM  Halo  settings) 


>  L-HE 


M5  (Behavioral  modeling) 


L-Roule  ■ 
L-P 
L-PC 

L-  R  - 


Risk  assessment  (IED) 


►  r  _  _ 

Risk  assessment  (DF) 


Risk  assessment  (R2P) 


|— SR-RV-*  L-R 
SR-RV  *  I  P 


M6  (Historical  sites) 


L-Poly- 


SR-RV 


L-HE 


SR-RV:  send  request 
and  return  value 


M7  (Point  fi Iteration) 


L-Poly 


L-P  /  L-R 
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k 

|  Display  radius4 
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r 

*  Do  not  apply  for  Route 
Exposure  and  Curvature 


M8  (Map  Drawing) 


L-P  /  L-R 


L-HE 


HeatMap  overlay 

L-PM 


M9  (MLC  settings) 


SR-RV-*  L-C 


MtO  (Route  prediction) 

Chosen  Classifier  from  L-C- 


MLC 

—SR-RV-*  L-R 

P 
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Appendix  4.  MECH  classifier  training  flow  chart 


GUI  tabs 
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